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The quality of national examination items plays an enormous role in identifying 
students’ competencies mastery and their difficulties. This study aims to identify 
the difficult items in the Junior High School Mathematics National Examination, to 
find the factors that cause students’ difficulty and to reveal the strategies that the 
teachers and the students might implement in order to overcome them. The study is 
phenomenological research with the mixed methods. The data were collected using 
documentation of students’ responses and focus group discussion (FGD) of 
teachers. The data analysis was conducted using Milles & Hubberman steps. The 
results of the study showed that there were 4 difficult items of the 40 test items for 
the students. The students’ difficulties were the lack of concept understanding, 
difficulties in calculating, difficulties in selecting information, being deceived by 
the distractors, being unaccustomed to completing complex and non-integers test 
items, and completing contextual test items that have been presented in the form of 
figures or narrative texts. 

Keywords: difficult items, influencing factors, teachers’ strategy, examination, 
mathematics 

INTRODUCTION 

In education, assessment is an important matter in order to identify an educational 
success. The results of the educational assessment have a major function that will be 
useful in further educational processes. Two major functions are to measure the 
students’ achievements and to motivate and direct students’ learning (Ebel and Frisbie, 
1991). In mathematics education, one of the major functions is to identify how far the 
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students have possessed the ability in certain subjects such as mathematics. In addition, 
to identify the students’ ability or understanding, the assessment results also provide 
certain concepts such as the concepts of mathematics that the students have not 
mastered. Through the assessment results, the teachers or school might improve the 
learning process and students can change their strategy for studying. 

The results of the educational assessment in Indonesia, especially in mathematics, have 
not satisfied many parties over years. It can be seen in the situation that might be found 
both by means of students’ average score in the Mathematics National Examination and 
the results provided by the international studies. Based on the results of the national 
examination, the students’ achievements have not been satisfying (Balitbang 
Kemendiknas, 2011, 2012, 2013). These results show that there have been many 
students who still have difficulties in certain items in the mathematics test of the 
National Examination. Meanwhile, the results of the international studies also show 
similar results, based on the results of an international assessment using PISA (Program 
for International Student Assessment) (OECD, 2014) or TIMSS (Trends in International 
Mathematics and Science Study) (Mullis et al. , 2012). 

The 2014 National Examination used 20 battery set packages in order to maintain the 
reliability of the students’ national examination results. With the 20 set packages, it was 
expected that the schools might minimize cheating during the administration of the 
national examination which had run for years. Unfortunately, the varied test packages 
caused new difficulties among the students although these test packages had been 
designed under the same blueprint and indicators. The students might have more 
difficulties since the item difficulty of the test would be elevated. The quality 
improvement was apparent from the addition of TIMSS or PISA test items, which have 
the international quality, into the national examination battery set package. As a result, 
the students had difficulties in completing these test items, especially those who were 
not familiar with the internationally standardized test items. 

The difficulties in completing the national examination test items become a matter of 
reflection both for the teachers and students. The teachers and students should learn 
from the students’ difficulties in order to identify the parts or the indicators that the 
students consider to be difficult. A similar situation has been stated by Meese 
(Tambychik and Meerah, 2010, p.145) as follows: “Teachers need to understand 
students’ potential, problems and learning difficulties in order to implement effective 
teaching strategies and to produce meaningful learning among students.” After the 
teachers find the difficult indicators, they might create new learning strategies that will 
be meaningful for providing the students’ conceptual understanding towards the students 
regarding the difficult indicators. Multiple learning strategies might be applied in the 
learning process by adjusting the students’ conditions, the materials or the indicators 
that will be studied and the drawbacks of each student. Mundia (2010, p. 152) states, 
“Each teaching technique has its own strengths and weaknesses and there are several 
other factors that need to be taken into consideration for teaching to be effective with 
special needs of students.” Thereby, there should be an appropriate selection and a 
consideration before the teachers apply the learning strategies or techniques within the 
learning process in the classroom according to the students’ needs. 
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The difficulties that the students have in completing the overall national examination test 
items can be identified by implementing the classical test theory and the item-response 
theory. The indicators that have been considered to be difficult by the students will be 
reflected from the students’ scores or results. The students’ scores for each item will be 
analyzed by performing the classical test theory utilizing the proportion of the students’ 
correct answers. The proportion of correct answers in the classical test theory will reflect 
which items are difficult for the students. Each test item describes each indicator so that the 
proportion of correct answers will describe the indicators that the students consider to be 
difficult as well. The higher the score or the proportion of the correct answer, the easier the 
test items will be for the students. On the other hand, the lower the score or the proportion of 
the correct answer, the more difficult the test items will be for the students. 

The test items become difficult for the students for several reasons. One of the reasons is 
that the numbers in the test items are not integers or the students have not understood the 
materials or the concepts in the completion of the test. The test items require complex 
completion steps or they should be completed through several phases. According to Yusha’u 
(2013), several matters that cause the students’ difficulties in learning mathematics are the 
students’ unpreparedness in the learning process; the students’ low self-confidence in 
completing the mathematical problems; the low motivation of students, the teachers, the 
parents, and the relatives; and the students’ weak fundamental ability in mathematics. In 
addition, mathematics also demands several skills that the students should master. Based on 
a study by Tambychik and Meerah (2010), there are five types of mathematics skills: number 
fact skills (proficiency of number facts, tables and mathematics principal); arithmetic skills 
(accuracy and logarithm in computational and mathematical working-procedure); 
information skills (expertise to connect information to a concept, operational, and 
experience as well as the expertise to transfer information and transform problems into 
mathematical sentence); language skills (proficiency of terms and relevance of arithmetical 
information); visual spatial skills (skill to visualize mathematical concepts, and manipulate 
geometrical shape and space meaningfully). According to Gooding (2009, p.33), the forms 
of students’ difficulties in completing mathematics test items are 

“. reading and comprehension; decoding words in a word-problem; understanding 

the meaning of the words and sentences; reading and understanding all of the 
information; distracting information; imagining the context; writing a number sentence; 
carrying out the calculation; lack of accurate methods for calculating; making a mistake 
when calculating; interpreting the answer in the context of the question; giving an 
answer that is possible or likely; and transferring an answer into the required format 

The multiple mathematical skills that should be mastered in solving the mathematical 
problems make several students unable to master the overall skills and the situation affects 
the results of the Mathematics National Examination, which has been considered to be 
difficult. The situation will be worse if the students are not accustomed to solve the 
mathematical problems that involve the overall mathematical skills. In order to overcome the 
situation, the teachers may pursue combinations of the mathematical skills by administering 
the mathematical problems that combine several mathematical concepts. The quite complex 
mathematical problems might be derived from the combination between of multiple 
mathematical concepts and problem solving strategies and such mathematical problems 
might be difficult for the students. The reason for pursuing such a combination is that the 
students will have a higher cognitive load. According to Tambychik and Meerah (2010), 
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difficulties in mathematic problem solving are due to the incompetency in acquiring many 
mathematical skills and the lack of cognitive learning abilities. However, the students’ 
mathematical difficulties are not from the students’ factors themselves. As having been 
explained by Yusha’u (2013), the teacher’s problems in contributing to students’ low 
performance include teachers’ content knowledge of mathematics, strategy, method of 
presentation, and method of evaluations. Therefore, the teachers should also be aware of 
improving their self-quality within the mathematics teaching. As a result, there should be a 
study that will identify why the Mathematics National Examination test items become 
difficult for the students. 

The Purpose of Study 

The purposes of the present study are two-fold. The first is to identify the difficult test items 
for the junior high school mathematics national examination. The second is to find the 
factors that contribute to the difficult test items and the strategies that teachers and the 
students can implement in order to overcome the difficult test items. 

METHOD 

The study used the mixed method approach. The researcher implemented the quantitative 
approach first, in order to identify the difficult items based on the data of the students’ 
responses toward the national examination test items. Then, the researcher implemented the 
qualitative approach to identify the factors that caused the difficulties for the students along 
with the strategies that may be suggested toward the teachers and students so that they 
master the difficult test items. 

Data 

The data in the study were the Mathematics National Examination test item sets and their 
responses. The test item sets implemented in the national examination were 20 battery set of 
test packages. The term equal in the study meant that each test item within the 20 battery set 
of test packages were developed from the same blueprint. Each item measured the same 
indicator, so the difference would only be in the numbers. The sets along with the responses 
of the test participants were gathered using a documentation technique. 

The factors that caused the students’ difficulties in completing the difficult test items along 
with the strategies that the teachers and students may implement in order to overcome the 
difficulties were identified by focus group discussion (FGD). The FGD involved 15 
mathematics teachers of junior high schools from 12 provinces in Indonesia and 4 
mathematics experts. 

Participants 

The test participants who responded to the national examination were 46,313 students. 
These participants, or respondents, were all students of the junior high school in the 
Province of Yogyakarta Special Region, Indonesia, which, according to the Centre of 
Educational Assessment, Indonesia, has had a good credibility index in the national 
examination administration. The data from the documentation of the test participants’ 
responses toward the national examination test items were attained from the Centre of 
Education Assessment Indonesia. The FGD participants were 15 mathematics teachers (Tl- 
T15) of the junior high school from 12 provinces in Indonesia, consisting of 8 teachers from 
the Western Indonesian Region, 3 teachers from the Central Indonesian Region and 4 
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teachers from the Eastern Indonesian Region along with 4 mathematics experts (E1-E4) 
from the university. The composition of the participants was 11 male participants and 8 
female participants. The qualifications of the teachers attended the FGD were mathematics 
teachers who had been teaching in junior high schools for approximately 10 years and who 
had earned the undergraduate degree from the mathematics education study program. 

Data Analyses 

The data of the students’ responses toward the test item sets were analyzed by means of the 
classical test theory in order to identify the difficulty level. The difficulty level was 
estimated by calculating the proportion of the correct answers. The items would be 
considered difficult if the proportion of the correct answer for the item was lower than 
37.5% of the overall students. The difficult items were identified and the researcher found 
the tendency for each package. Next, the researcher rewrote the test items and would turned 
them into the FGD. Afterwards, the teachers concluded the reasons why the test items had 
been difficult for the students. 

Before performing the FGD, the FGD participants were asked to complete the test items 
first. Then, the teachers discussed the reasons why these items were difficult. In addition, the 
researcher and the participants discussed the strategies that the teachers might implement in 
the teaching strategies that might decrease or eliminate the difficulties for the students. 
Meanwhile, the results of the FGD were analyzed by means of the qualitative analysis model 
of Miles and Hubberman (1994). The stages of the analysis were data reduction, data 
presentation, data verification and conclusion. 

FINDINGS 

The data were analyzed based on the proportion of the correct answers. The mean of item’s 
difficulty indexes is presented in Table l.The difficulty level was reflected from the low 
mean in the proportion of correct answers. From the 20 national examination test item 
packages, the most difficult four test items for the students were the item s of 3, 13, 17, and 
21. The mean of the proportion of the correct answer was lower than 37.5%. Eater, the 
finding was subjected to the FGD to determine the problems that the students encountered 
and what the teacher can do in the teaching of difficult items. 


Table 1 

Mean of Difficulty Fevel 


Items 

Proportion 

Correct 

Items 

Proportion 

Correct 

Items 

Proportion 

Correct 

Items 

Proportio 
n Correct 

1 

68.6 

11 

56.7 

21 

16.0 

31 

56.5 

2 

56.8 

12 

52.7 

22 

61.8 

32 

81.7 

3 

5.4 

13 

31.9 

23 

60.3 

33 

56.6 

4 

58.8 

14 

52.0 

24 

50.1 

34 

49.8 

5 

66.6 

15 

57.4 

25 

40.8 

35 

47.3 

6 

56.9 

16 

39.9 

26 

47.9 

36 

68.7 

7 

67.8 

17 

37.0 

27 

56.9 

37 

40.4 

8 

57.8 

18 

44.2 

28 

70.5 

38 

61.2 

9 

62.6 

19 

46.2 

29 

44.4 

39 

75.0 

10 

57.7 

20 

61.9 

30 

57.9 

40 

62.6 
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Item 3 

3 

The result of 4= is ... . 

A.- B. - C. 2 D. 8 

3 2 

The percentage of the students who responded correctly to test items similar to Item 3 
above was only around 5.40%. In order to respond to Item 3 correctly, firstly a testee 

needed to perform the manipulation of changing 4 = 2 : into 2 2 ^ J = 2 3 = 8 . 


From the FGD, the teachers stated that in order to complete the stage 2"= J =2 3 , the 
students should understand first the characteristics of the exponential number operation 
and it was this concept that caused the students’ difficulties in answering this item. 
According to the teachers, several matters might cause the students’ difficulties in 
answering this item type. The first reason was that the students were not able to 

manipulate the exponential form of number 2 (4 = 2 2 ). Then, the second reason was 
that the students had lacked mastery of the characteristics of the exponential integer 

2 

operation and, as a result, they were confused when they got to 2 2 . The third reason 
was that the students had difficulties in performing the exponential integer operation 
with fraction, such operation involved multiplication. 

According to the FGD participants, in order to overcome these difficulties, one of the 
strategies that the teachers might implement in the learning process was strengthening 
the students’ understanding of main numbers and the exponents so that they would 

easily (intuitively) identify that 4 = 2 2 , 16 = 2 4 , SI = 3 4 , 125 = 5 2 and so on. The 
strengthening might be pursued by providing examples and exponential tables. Then, in 
order to overcome the second and the third reason, the teachers should emphasize the 
characteristics of exponential integer operations in which the exponents were in 
fractions. Meanwhile, in order to improve the students’ ability in strengthening their 
understanding of main numbers, exponents, and operations of fractional-exponent 
integer operations, the teachers should provide exercises that contained these three 
aspects. 

Item 13 

It is set P = {b, a, t, i, k}. The number of subset P is ... . 

A.32 B. 25 C.10 D. 5 

The percentage of the students who responded correctly to the above item was around 
31.90%. In order to answer the test item, a testee needs to understand the definition of a 
subset of a set. The subsets of P ={b, a, t, i, k} are { }, {b}, {a}, {t}, {i}, {k}, {b,a}, 
{b,t}, {b,i}, {b,k}, {a,t}, {a,i}, {a,k}, {t,i}, {t,k}, {i,k}, {b,a,t}, {b,a,i}, {b,a,k}, {b,t,i}, 
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{b,i,k}, {a,t,i}, {a,i,k}, {a,t,k}, {t,i,k}, {b,a,t,i}, {b,t,i,k}, {a,t,i,k}, {b,a,t,k}, {b,a,i,k}, 
{b,a,t,i,k} so that the number of the member in the set P was 32. After the students 
found the pattern and the number of the set P, they could track the subset of P using the 
Formula 2 n , in which n was the number of the set member. The number of P member 
was 5, so the number of the subset P was 2 5 = 32. According to the teachers, the 
students’ difficulties in completing the test item were the weak understanding of the 
concept of subset. Most of the students were confused to choose the concept between 
the members of a set and the members of a subset; as a result, they were tricked and they 
chose option D as the correct answer in which they found the member of a set instead of 
a subset. 

According to the teachers in the FGD, the students’ errors in responding to the test item 
might be minimized by strengthening their understanding about the number of a set 
member and the number of a subset member. The definition of each concept should be 
understood well along with students’ association. The relationship between the set 
member and the subset member resulted in the formula that the members of a subset 
should be equal to ... in which n was the number of subset members. The formula might 
be a further stepping point for emphasizing the differences between the two concepts. 

Item 17 

The line equation that will be parallel to the line that passes the coordinate point (2,5) 
and (-1,-4) is ... . 

A.y = -3x +14 B. y = -(l/3)x + 6 

C. y = (1/3) x + 4 D. y = 3x -4 

The percentage of the students who responded correctly to test item similar to the test 
Item 17 above was around 37.00%. The FGD participants agreed that in order to answer 
the test item, the students should understand that two lines would be considered parallel 
if they had the same slope. Therefore, the students should understand the procedure of 
locating the slope of a line if they knew two coordinate points that would be passed. For 
example, if the two coordinate points were (x a , y a ) and (x b , y b ) then the slope (m ab ) 

IVq, — J ,l h 

would be —~ . In the test item, the slope of the line that would pas (2, 5) and (-1,-4) 
x a x b 

5+4 _ _ 

were -— — o. The general straight line equation has been y = mx+c in which m is the 

slope and c is the constant; as a result, the general straight line equation with the 
gradient 3 would be y = 3x + c. Therefore, there will not be any line that is parallel with 
y = 3x + c. The line variation depends on the selection of c so that one of the lines that 
would be parallel to the line passing through (2, 5) and (-1, -4) would be y = 3x -4. 
According to the teachers, there are several reasons why the percentage of the students 
who responded correctly had been low. First, the students forgot the procedure of 
finding the slope. Second, they had not understood well the concept of two parallel lines 
and, thereby, it was highly possible that there had been some confusion between the 
concept of a perpendicular line and parallel lines. 
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Based on the teachers’ opinions, in order to minimize the students’ errors in answering 
similar test items, the teachers should provide the students with more in-depth 
understanding towards the concept of a straight line and a slope. There have been 
multiple procedures that might be implemented in finding the gradient value of a line, 
depending on the initial information found. In Item 17, the initial information that has 
been found was the two coordinate points that would be passed by the line. However, in 
other cases it is quite possible if the initial information that had been found was the line 
equations in the form of y=ax, y=ax+c or ax+by+c=0. In order to understand all of the 
equations, the students should be provided with various experiences in observing a lot of 
cases. Then, the next aspect that should be emphasized would be the understanding 
towards the concept of two parallel lines and two perpendicular lines. The students 
should understand the characteristics of both concepts so that they would definitely 
notice the differences. The emphasis on the differences between both concepts is the 
response to the case in which the students often mismatch the application of both 
concepts. 

Item 21 


Pay attention to the sailboat! 

About 95% of the world’s trading commodities have been sent through the sea 
transportation that involves 50,000 tankers, shipping boats and giant freights. Most of 
these ships make use of the diesel oil. 

The engineers have planned to build the supporting power by harnessing the wind for 
these ships. Their idea is to install the kite sail to these ships and to use the wind power 
in order to decrease the diesel oil consumption and the impact of the diesel oil towards 
the environment. 


Based on the description, 
how long will the rope from 
the kite sail to the ship be in 
order that the kite sail draws 
the ship on the 45° angle and 
the 150 m height as shown in 


picture? 


A. 

175 

m 

B. 

212 

m 

C. 

285 

m 

D. 

300 

m 
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The percentage of the students who responded correctly to the Mathematics National 
Examination test item similar to the test item number 21 above was around 16.00%. 
According to the teachers, the students might answer the test items by understanding 
triangle characteristics in which the total amount of a triangle’s degree should be equal 
to 180°. Thereby, the students might conclude the other angles that might be formed 
from the 45° angle; in other words, the triangle should be the isosceles right triangle. 
Then, the second material that the students should understand was the application of 
Pythagoras theorem in determining the necessary minimum length of the rope. The 


length of the rope is ISO 3 -|- 15G 2 )m, then the students would find that the length of 
the rope would be equal to 212.1320344 m. The teachers explained that such complexity 
had been the cause of the low percentage of the students who responded to the test item 
correctly. The test item was considered too long by the students and, as a result, they felt 
that such test items were difficult, tough, and complicated. The situation led to the 
students’ decreasing interest in answering the test item. The low interest also became the 
main factor that caused the students’ low efforts. In other words, it was possible that the 
students who had a low interest could not answer the test items well. The number that 
had been used was so big, that it caused the calculation difficulties. In addition, the 
students were also confused because the number was not part of integers (212.1320344). 
In general, within the completion process, the students did not always focus on the 
calculation; instead, they focused on the commonality of the calculation results and the 
consideration with the appropriate alternatives and their own perception. Such 
calculation results would cause the students to doubt the answer and to perform re¬ 
calculation or to be confused and to give up. Last but not the least; the students were not 
accustomed to attaining information in the form of a contextual figure. The impact 
would be that the students were confused in interpreting the information and the 
direction within the test items. 

The teachers stated that in order to minimize the errors in answering similar test items, 
there should be some short ways in strengthening the concept of a triangle and the 
application of the Pythagoras theorem. The students should master the triangle 
characteristics so that they might have access to the information related to triangles 
intuitively and immediately. In addition, the students should be provided with test items 
related to the application of the Pythagoras theorem, especially the calculation part. The 
students should also perform the calculation well although the calculation involved big 
numbers. Another strategy would be habituating the students to attain and to solve the 
contextual problems that had been stated in the form of a narrative text or figure. 
Increasing the students’ ability in understanding test items in the form of a narrative text 
or a figure might not be done instantly; as a result, there should be periodical exercises 
in order to make the students get accustomed to the Pythagoras theorem calculation. 

Based on the results of the focus group discussion, the students’ difficulties can be 
summarized. Then the participants of FGD describe the causes, as well as strategies, that 
can be implemented to improve them. The results are presented in Table 2 below. 
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Table 2 

The Result of Focus Group Discussion 


The Students’ The Cause of Teachers’ Strategies to Overcome Students’ 

Difficulties Students’ Difficulties 

Difficulties 


The lack of 
conceptual 
understanding, 

Difficulties in 
calculating, 

Difficulties in 

selecting 

information, 

Being deceived by 
the distractors, 

Being 

unaccustomed to 
completing complex 
and non-integers 
test items 


Factors of the 
mathematics nature: 
The lack of 
fundamental 
understanding of 
mathematics, 
mathematical 
properties that are 
complex. 


Factors of students: 
Lack of motivation 
to complete the 
mathematics test 
items 


Strengthening the students’ understanding, 
providing the students with the problem models 
especially the ones related to the real context, 
providing them with various exercises with big 
numbers and non-integers, habituating them to 
answer contextual test items presented in the 
form of figures and narrative texts, habituating 
them to answer test items through several steps 
of completion instead of operating the steps 
directly through basic concepts, and habituating 
them to complete test items whose alternatives 
are in narrative texts (not only involving 
numbers). _ 


Raising students’ motivation to study 
mathematics. 


Completing Factors of teachers: Conducting mathematics teaching and learning 

contextual test The mathematics effectively: preparing a long-term planning, 

items that have teaching and structured preparation, and well-designed 

been presented in learning was not strategy to improve quality of learning. 

the form of figures effective _ 

or narrative texts. Factors of school: 

The lack of support Optimizing the school and parents’ support 

from school 


Factors of parents: 
Not all parents 
remind students to 
practice and learn 
math 


The difficulties presented in Table 2 were caused by several factors namely the nature of 
mathematics, students, teachers, schools, and parents. These are as follows. 

From the perspective of the factor of a learning content, the concepts established in 
mathematics are the basic concepts of the other sciences. Mathematics has various 
concepts, symbols and formulas that can be used to solve all of the mathematical 
problems. When students are answering items, they should link concepts, symbols, and 
formulas then combine them to solve problems. This causes students' difficulties to 
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appear, including making a mathematical model from narrative items. This is confirmed 
by teachers’ statements as follows. 

"Students understood the concepts partially, or knew how to utilize formula. But 
when they combined them, they found many troubles. "(Tl, T9) 

"Students could understand the narrative items, but the difficulty was how to 
make the problem into a mathematical model to be solved later. "(T10) 

Besides containing having various concepts and symbols, the mathematics national 
examination test items are considered difficult by the students since they have almost 
similar characteristics, namely demanding several steps of completion in order to obtain 
the correct answer. The combination of several steps in completion demands very high 
understanding of basic mathematical concepts which help the students in answering the 
national examination questions. 

From the students’ factor, the cause of the students’ difficulty to answer items that 
require manipulation of numbers, relate to real-life contexts, require many steps, solve 
problems in the form of a story, and have a lack of exercises in deepening the 
mathematical concepts after being learnt. This is stated by teachers as follows. 

"Students did not use to practice problem solving to strengthen the 
understanding of mathematical concepts."(T2, Til) 

"Students were reluctant to answer problems that include many steps. 
Similarly, students were confused to determine what information was used to 
answer the questions in narrative items. "(Til) 

The third factor was the teacher factor. When viewed from the teacher factor, the 
difficulties caused by the ineffectiveness of mathematics teaching and learning lessons 
which conducted by teachers. This is evident from the statement of teachers about 
teaching and learning as follows. 

"The teaching and learning seems less effective. During the teaching, we 
further pursue the coverage of content, so the students couldn’t get deep 
understanding. Students also didn ’t do enough exercises.... "(T5) 

"There were a lot of teaching contents that should be learnt by students, we 
have less time to teach until students ’ understanding was deep, including the 
addition of problem solving exercises for the students. ”(T6) 

Ideally, the school fully supports the implementation and improvement of the quality of 
teaching and learning, including mathematics teaching. However, not all schools provide 
full support, because of various limitations, such as funding and time. It was stated by 
the teachers as follows. 

"Our school supports improvement of learning, but when we implemented a 
new teaching approach that required specific tools, teachers should supply 
them by themselves, it is caused by the limitation of funding. "(T2) 
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"We are allowed to do professional development such as training to improve 
quality of teaching, hut it should not bother teaching activities. "(T12) 

The lack of parental support is also a factor that causes students’ difficulties in 
answering items. Based on information from teachers, it was found that not all parents 
reminded students to practice mathematic exercises at home. Not all parents who 
supported their children understood the contents of the materials studied by students. It 
was stated by the teacher as follows. 

"Not all parents reminded their children to study mathematics or practice 
mathematics exercises at home. "(T10) 

"... if students have difficulties in mathematics, not all parents could help 
explaining it. "(T9) 

The various difficulties could be overcome by looking at the causes. Difficulties which 
are associated with the nature of mathematics could be overcomed by deepening the 
concept understanding of the students. One of the strategies to overcome these 
difficulties is by implementing meaningful mathematics teaching and learning. In order 
to obtain the meaningful learning, teachers could integrate the understanding of the 
concept utilizing real contexts which students are familiar. This opinion was expressed 
by teachers as follows. 

"In my experience, understanding of the concept could he strengthened by 
integrating the concept of learning in the context and daily life faced by 
students. "(Til) 

Overcoming the students' difficulties caused by student and teacher factors can be done 
by increasing the effectiveness of teaching. The lack of motivation from students to 
strengthen the concept understanding and to resolve complex and narrative problems 
can be handled through improvement of teaching. Another tactic is by awarding the 
students who are successful in solving test problems. It was stated by the teacher as 
follows. 


"Increasing the students’ motivation could be done with the improvement of 
learning quality, using contemporary learning approaches, such as project 
based learning or problem-based learning. This learning approach makes 
students motivated to learn. "(T10) 

"Awarding students was also a way to motivate students, I have done it. If the 
student has successfully solved the math problem, I gave a special praise. 
Students would be happy and be motivated to learn.... "(T10) 

In addition, to increase motivation, learning improvement can also optimize learning 
outcomes and reduce the students’ difficulty. In order to implement learning effectively, 
teachers need to formulate clear learning outcomes, prepare lesson plans well, choose 
the appropriate learning strategy and content being studied, and conduct an assessment 
in accordance with the learning outcomes that have been formulated. Teachers should 
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also use learning strategies in accordance with the students’ needs, for example using 
peer tutorial approach. This is based on the following statement from teachers. 

"We prepared lesson plans, implement teaching to ensure the objectives were 
achieved, develop appropriate worksheet, assess and utilize the assessment 
results to improve learning. "(T5) 

"If necessary, we asked students who already understood the material to 
explain to their friends, and also provide tutorials for students in need. "(T15) 

The strategy to complement the efforts to reduce the students’ difficulties in doing the 
national exam was the school support to the implementation of mathematics learning 
and the parental support of student learning. To obtain the support from the school, 
teachers suggested something needed to do with other teachers together. The school 
support could be in the form of monitoring and evaluating of the teaching and learning. 
The monitoring and evaluating were implemented to make sure that the teaching and 
learning were conducted effectively. Meanwhile, to obtain support from parents, 
teachers involved the parents to sign students’ homework or outcomes of assessment. 
The strategies to improve both supports were expressed by the teacher as follows. 

"If we needed the school support for the implementation and enhancement of 
learning, we should hold a small meeting with other teachers, and proposed it 
to the school."(T10) 

"... The school should monitor and evaluate the mathematics teaching and 
learning, to make sure that they have done it effectively. ”(E1) 

"In order to monitor the development of students’ achievement, homework and 
assessment results must be signed by parents. The parents could monitor and 
understand the development of their children. "(T9) 

DISCUSSION 

Based on the research results, it can be stated that students had difficulties in answering 
the four difficult items of the mathematics national exam. The difficulties are the lack of 
conceptual understanding, calculating, selecting information, being misled by the 
distracters, being unaccustomed to answering complex and non-integers test items and 
answering the contextual test items that have been presented in the form of figures or 
narrative texts. The research result about the students’ lack of understanding in 
fundamental mathematic concepts was in line with research from Gooding (2009), 
Ismail, Shahrill and Mundia (2015) and Maarif (2016). 

To overcome the students’ difficulties associated with the nature of mathematics can be 
done by strengthening the students’ mathematical understanding of the mathematical 
concepts. Concept understanding can be achieved through learning utilizing the contexts 
that students face every day. These are supported by the research results in which 
concept understanding was done by providing exercise to the students through activities 
and real things that exist around the students (Ali, 2011) and to make connections 
between everyday problem solving with experiences (Antony and Walshaw, 2009). The 
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result was in line with the statement of Bradley et al. (2008) about the need to connect 
the concepts and symbols with things that had been known by the students. 

Further understanding about the real factor causing difficulties from students themselves 
was the lack of students’ motivation. The students’ lack of motivation made them less 
understand the mathematics concepts and then they had difficulties when answering 
mathematics problems. These results are consistent with the results of research on the 
lack of students motivation in resolving mathematics problem (Yusha’u, 2013; Ismail, 
Shahrill and Mundia, 2015) and the reluctance of students to work on problems that are 
complex and that contain many steps (Jailani and Heri Retnawati, 2015). 

Based on this study, increasing the motivation of learning can be enhanced through 
improvements of mathematics teaching and learning in the classroom. Efforts to increase 
the students’ motivation utilizing improvement of learning quality were in line with 
Sorensen (2006) and Ali (2012), while giving awards to students was according to the 
results of research of Middleton and Spanias (1999). Furthermore, giving awards as one 
of the various ways to express the students’ understanding which can be done using the 
portfolios was the result research of Furner and Gonzales-Dehasa (2011). 

In addition, to increase motivation, improving the quality of learning can enhance 
students' understanding of mathematical concepts. The learning activities can be 
followed by providing the students with problem models especially the ones related to 
the real context, providing them with various exercises with big numbers and non¬ 
integers, habituating them to solve contextual test items presented in the form of figures 
and narrative texts, and habituating them to answer test items through several steps of 
completion instead of operating the steps directly through basic concepts. The 
mathematics teaching and learning could be directed to habituate students to complete 
problem solving in which the alternatives are in narrative texts. The efforts were 
consistent with the research results to optimize learning to improve students’ 
understanding and math skills (Aisyah and Retnawati, 2014; Sulistyani and Retnawati. 
2015; Trisnawati and Wutsqa, 2015; Jailani and Retnawati, 2015) and also the 
preparation of learning well, a well-executed teaching, a support of curriculum and 
appropriate learning strategies (Ismail et al., 2015). 

Mathematics teachers in a school have a variety of tasks, such as developing lesson 
plans, implementing teaching and learning in many parallel classes, and conducting 
assessments and improving the learning using the assessment results. These heavy tasks 
were burdening mathematics teachers. The burden of teachers caused the low 
effectiveness of teaching and learning implementation, which led to poor understanding 
of the students’ mathematical concepts. The lack of understanding of students led to 
difficulties in problem solving, especially for items that require algebraic manipulations, 
many steps of completion, related to the context or presented in narrative text. From the 
previous research, the teachers’ burden was causing less optimal learning (Retnawati, 
2015; Jailani and Retnawati (2015), also teacher learning behaviors affect student 
achievement (Pimta et al., 2009). 
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In addition students and learning factors, another factor that caused difficulties was the 
lack of support from the school and parents. This difficulty can be improved through 
effective communication, from teachers to schools and from teachers to parents. With 
the support of the school, the teaching and learning that would be implemented by 
mathematics teachers become more effective. The research about the influence of school 
support for the implementation of effective learning has been done by previous 
researchers. To implement effective learning, the schools should have the availability in 
supporting the learning sources and teaching equipment (Ismail et al. , 2015), the school 
should conduct the monitoring of curriculum implementation (Retnawati, et al ., 2016), 
as well as supported the use of ICT (Ayub and Bakar, 2012). Research on the parental 
support showed that there was a positive effect on students' mathematics achievement 
(Bempechat, 1982; Vucovic et al., 2013).. 

CONCLUSION 

From the 20 National Examination test packages, the items that the students consider to 
be difficult are items 3, 13, 17, and 21. The students’ difficulties in answering these 
items are the lack of concept understanding, difficulties in calculating, difficulties in 
selecting information, being tricked by the distracters, being unaccustomed to working 
with complex and non-integer test items, and answering contextual test items that are 
presented in the form of figures or narrative texts. In addition, another cause of students’ 
difficulties is the inaccuracy of students’ calculation. 

Some suggestions that the teachers might give to overcome the students’ difficulties in 
answering items include the need for strengthening the students’ understanding, 
providing the students with problem models especially the ones related to the real 
context, providing them with various exercises with big numbers and non-integers, 
habituating them to complete contextual test items presented in the form of figures and 
narrative texts, habituating them to complete test items through several steps of 
completion instead of operating the steps directly through basic concepts, and 
habituating them to complete test items in which the alternatives are in narrative texts 
(not only involving numbers). 

Other factors that contribute to overcome students’ difficulties in answering the 
mathematics National Examination test items or in paying attention to the mathematics 
learning processes in general are the factors in mathematics themselves. Mathematics 
has a lot of concepts that students should understand so that they can associate these 
concepts with the real matters around them through songs or other media that make them 
easily remember or understand. In addition, schools should prepare a long-term 
planning; make structure of preparation and a well-designed strategy in order to 
overcome the problems such as the teachers’ incapability to perform the in-depth 
mathematics teaching process. Furthermore, schools should also provide teachers with 
freedom in designing the syllabus and in preparing tests or examinations. Last but not 
least, parents constitute the main factor in monitoring the students’ academic 
development that affects students’ condition in the mathematics learning processes. 
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Turkish Abstract 

Ulusal Matematik Sinav Sorulan Neden Zor ve Ogretmenlerin BununUstesinden Gelmek 
I^in Stratejileri Neler? 

Ulusal sinav soralarimn kalitesi, ogrencilerin yetkinliklerinin ve zorlandiklari konularm 
belirlenmesinde biiyiik rol oynamaktadir. Bu gah§ma, Ulusal Ortaokul Matematik Smavimn zor 
ogelerini belirlemeyi, ogrencilerin zorlanmalarma neden olan faktorleri bulmayi ve ogretmenlerin 
ve ogrencilerin uygulayabilecekleri stratejileri ortaya gikarmayi amaglamaktadir. £ali§ma karma 
yontemle yapilmi§ fenomenolojik bir ara§tirmadir. Veriler, ogrenci yamtlarimn dokumantasyonu 
ve ogretmenlerin odak grup goru§mesi (FGD) kullamlarak toplanmi§tir. Verilerin analizi, Milles 
& Hubberman adimlari kullamlarak gergekle§tirilmi§tir. £ali§manm sonuglari smavm 40 test 
ogesinden 4'iiniin ogrenciler igin zor oldugunu gostermi§tir. 

Anahtar Kelimeler: zor ogeler, etkileyen faktorler, ogretmenlerin stratejileri, smav, matematik 


French Abstract 

Pourquoi sont les Mathematiques Articles d'Examen nationaux Difficiles et Comment la 
Strategic de Professeurs doit Le surmonter? 

La qualite d'articles d'examen nationaux joue un enorme role dans l'identification de la maitrise 
de competences des etudiants et leurs difficultes. Cette etude a pour but d'identifier les articles 
difficiles dans les Mathematiques de College l'Examen national, trouver les facteurs qui causent 
la difficulty des etudiants et reveler les strategies que les professeurs et les etudiants pourraient 
mettre en oeuvre pour les surmonter. L'etude est la recherche phenomenologique avec les 
methodes mixtes(melangees). Les donnees ont ete rassemblees utilisant la documentation des 
reponses des etudiants et la discussion de groupe de discussion (FGD) de professeurs. L'analyse 
de donnees a ete conduite utilisant des Pas(Etapes) de Hubberman et des Moulins(Usines). Les 
resultats de l'etude ont montre qu'il y avait 4 articles difficiles des 40 articles de test pour les 
etudiants. 

Mots Cles: articles difficiles, influengant facteurs, la strategic de professeurs, examen, 
mathematiques 


Arabic Abstract 

L-tlaall £)±a1xa1\ 4jyjijjlm) Laj (jladal J jli I jbd 

a^A c Vlg 'i A dle-li^ll (jlalij cJLlA L. f 

L_L/Uall Ajjx kst ^ i n>n il (jl-dLaVI la 11 

^)Al^la]| ^A \ g jlc. ^ Ia.V^Vi t—AUallj dl j-nj'iI I qC- <. 

JokJ yi # (jAAix-di (FGD) ^t—L/Uall dbUJ ^(jdduAj dULull ^-a^. y L Vi-dll jj^ 3 ^ 

.t—L/Uail j)\ j'i S. ' a^La 40 lG 3 ^ ^ J* 4 4_uil d^Jaij # (jLa^)J^A j dl jL'n ^LVdilj dljL4l 

dll jdal jGG 4 ia^jydl Ual^jxll ’A dll 
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German Abstract 

Warum sind die Mathematik-Nationalen Priifungsgegenstande schwierig und was ist die 
Strategic der Lehrer zu iiberwinden? 

Die Qualitat der nationalen Priifungsgegenstande spielt eine enorme Rolle bei der Ermittlung der 
Kompetenzen der Studierenden und ihrer Schwierigkeiten. Diese Studie zielt darauf ab, die 
schwierigen Punkte in der Junior High School Mathematics National Examination zu 
identifizieren, um die Faktoren zu finden, die die Schwierigkeiten der Schuler verursachen und 
die Strategien offenbaren, die die Lehrer und die Schuler umsetzen konnten, um sie zu 
iiberwinden. Die Studie ist phanomenologische Forschung mit den gemischten Methoden. Die 
Daten wurden unter Verwendung der Dokumentation der Schiilerreaktionen und der 
Fokusgruppen-Diskussion (FGD) der Lehrer gesammelt. Die Datenanalyse wurde mit Milles & 
Hubberman-Schritten durchgefuhrt. Die Ergebnisse der Studie zeigten, dass es 4 schwierige 
Gegenstande der 40 Testartikel far die Schuler gab. 

Schlusselworter: schwierige gegenstande, einflussfaktoren, lehrerstrategie, untersuchung, 
mathematik 


Malaysian Abstract 

Mengapa Item Peperiksaan Negara Matematik Sukar dan Apakah Strategi Guru 
Mengatasinya? 

Kualiti item peperiksaan national memainkan peranan yang besar dalam mengenal pasti 
kecekapan pelajar dalam penguasaan dan kesukaran mereka. Kajian ini bertujuan untuk mengenal 
pasti perkara-perkara yang sukar dalam Ujian Nasional Junior High School Mathematics, untuk 
mencari faktor-faktor yang menyebabkan kesukaran pelajar dan mendedahkan strategi guru-guru 
dan pelajar-pelajar yang mungkin boleh dilaksanakan untuk mengatasinya. Kajian ini adalah 
kajian fenomenologi dengan kaedah campuran. Data yang telah dikumpulkan menggunakan 
dokumentasi jawapan pelajar dan perbincangan kumpulan fokus (FGD) guru. Analisis data 
dijalankan dengan menggunakan langkah Milles & Hubberman. Keputusan kajian menunjukkan 
bahawa terdapat 4 item sukar daripada 40 item ujian untuk pelajar. 

Kata Kunci: item sukar, faktor yang mempengaruhi, strategi guru, peperiksaan, matematik 


Russian Abstract 

IIoHeMy Cjkwkho FLjyuaTb IIpeAMeTbi DioaivieHOB no MaTeMamKe n Hto CTpaTernn 
yuHTejien IIpeoAOJieBaeT? 

KauecTBO HaijHOHajibHbix 3K3aMeHaijHOHHbix npe^MeTOB nrpaeT orpOMHyio pojib b BbiaBjieHnn 
MacTepCTBa CTyzjeHTOB h hx Tpy^HOCTen. 3to HCcne^OBaHHe HanpaBjieHO Ha BbiflBjieHHe 
Tpy/jHbix BonpocoB b HaunoHajibHOM 3K3aMeHe no MaTeMaTHice Mna^mux KjiaccoB 
Cpe^HeH IIlKOJibi, Haifra (J)aKTOpbi, KOTOpbie Bbi3biBaiOT Tpya,HOCTH y ynamHxcn, h BbMBHTb 
CTpaTernn, KOTOpbie Moryr peajiH30BaTb yuHTejin h CTy/jeHTbi, HTodbi npeo/jojieTb hx. 
Hccjie^OBaHHe nBjineTCJi (JieHOMeHOJiorHHecKHM Hccne/jOBaHHeM co CMemaHHbiMH MeTo^aMH. 
^aHHbie 6bijih codpaHbi c Hcnojib30BaHHeM ^oKyMeHTauHH otbctob CTy/jeHTOB h (j)OKyc- 
rpynnoBOH ^HCKyecHH yHHTejien. AHajiH3 ^aHHbix npOBO^HJicn c Hcnojib30BaHHeM maroB 
Mahirsa h TydepMaHa. Pe3yjibTaTbi HCCJie^OBaHHJi noKa3ajiH, hto j\jik CTy/jeHTOB 6biJio 4 
Tpy^Hbix npe^MeTa H3 40 tcctobbix npe/jMeTOB. 

KmoueBbie CjiOBa: cjio>KHbie npe/jMeTbi, Bjimnomne (J)aKTOpbi, CTpaTernn yuHTenen, 3K3aMeH, 
MaTeMaTHKa 
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